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FOREWORD 



Our Interest in the related-sample proportion or percentage test was aroused by 
the pract:ical question of whether large-sample tests were appropriate for several 
small samples in hand* In comparing the approximate and exact sampling distributions} 
it became apparent that the number of samples and the amount of correlation between 
them, as well as their sizey affected the accuracy of the approximations. 

By the time we found out that no simple or general rules regarding minimum sample 
size could be madey we had constructed rather numerous exact distributions. We decided 
to continue until we had complete tables of significance levels for samples yielding 
matrices varying in size from (a) three columns and twelve rows to six columns and five 
rowS} including all combinations of row totalSy and (b) seven columns and six rows to 
sixteen colTunns and three rowsy with row totals equal to half the number of columns » if 
that niimber is event or half the number of columns less one-halfy if that number is odd. 
The tables are presented as Tables A and B» respectively} of this report. 

The work was carried out under the Cooperative Research Program of the United 
States Office of Education. We wish to acknowledge the advice and help of two members 
of that Office: Howard Hjelm and G..enn Boerrigter. A preliminary study was supported 
by the Committee on the Advancement of Research of the University of Pennsylvania. 

Several persons have assisted directly with the study. Peggy Savage helped faith- 
fully and competently with the extensive computations. Sylvia Charp and Donald Ware 
explored computer possibilities. Mary Roberts prepared the first sets of tables. 
Geraldine Higgs painstakingly transformed tables and text to typescript for offset re- 
production. We are indebted to them. 

Finally} we wish to thank Eleanor Boll} Director of the Carter Foundation of the 
University of Pennsylvania} for her interest and cooperation in both the preliminary 
and final studies. 
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INTRODUCTION 



The problem of comparing two or more related-sample proportions or percentages 
arises where an investigator has dichotomous data classifiable in r rows and £ columns. 
Such data originate in situations where each of r subjects is observed under each of _c 
treatments or conditions. If a success or presence of some characteristic is observed 
on the ^ subject under the ^ condition, 1 is recorded in the cell; if a failure or 
absence of the characteristic is observed, 0 is recorded. This is typically the situa- 
tion in test-item analysis where each of r examinees passes or fails each of c test items. 
Or, an investigator may have o samples of blood from each of r patients known to have a 
certain disease and may apply a diagnostic test to each sample, recording 1 or 0 for the 
^ sample under the ^ test, depending on whether the result is positive or negative. 

As a third situation, an investigator may have r groups of c matched or related indi- 
viduals and may record 1 or 0 for the individual in the cell, depending on whether 
the individual responds or does not respond to a given task in a certain way. 

The data and schema for comparing related-sample percentages are shown in Table 1. 

It will be noticed that the table is similar to that used in conventional two-way analy- 
sis of variance in the r by c table, one observation per cell. When dichotomous data are 



Table 1. Schema and data for comparing related-sample percentages. 



Subject (i) 


1 


Treatment or 
2 5 


Condition (j_) 

4 ... 


c 


Total 


1 


1 


1 


1 


1 


• 


• 


• 


1 


"l 


2 


1 


1 


1 


1 


• 


• 


• 


0 


^2 


3 


1 


1 


1 


0 


• 


• 


• 


0 




k 


1 


1 


0 


0 


• 


• 


• 


0 


% 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


• 


r 


0 


0 


0 


0 


• 


• 


• 


0 


^r 


Total 


^1 


T 

2 


*3 


■^4 


• 


• 


• 


T 

c 


- ? 



classified as in Table 1, the question of interest usually is whether the proportions 
or percentages of I's in the columns are significantly different. To answer the ques- 
tion, the null hypothesis that the c population percentages are equal is tested against 
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the alternatire hypothesis that one or more is different from the others. 

Although several large-sample tests of the hypothesis have been developed^ no exact 
test is available. It is our purpose to present tables of exact significance levels for 
comparing percentages in small related samples and tables for the Brown-Mood median test* 
a special case of the related-percentage test. We begin with a review of large sample 
tests. 



LARGE SAMPLE TESTS 



The c (>2) Sample Case . Cochran (1950) gives a statistical testy the Q testy for 
the significance of differences among proportions or percentages in ^ samples when r is 
large. He shows that the limiting distribution of the quantity Qy 



Q 




( 1 ) 



as r increasesy is the distribution with (c-l) degrees of freedomy 
mu\ber of columns (samples) y T. the sum. of I's in the ^ columny T. 
and the number of I's in the ^ row. Cochran notesy p. 259* 



where jc is the 
the mean of the T.y 

V 



. . . The only restriction needed is a rather obvious onsy xo 
guard against the possibility that as the number of rows tends to 
infinityy the value of might be ^ or 0 in all but a finite 
number of rows. If this happensy the size of the population is 
still finite in the limity because permutations within rows 
having u. - jc or 0 do not generate any new oases. This situation 
is avoided by stipulating that for at least one intermediate value 
number of rows having that value must tend to infinity. 



In considering the exact sampling distribution of Qy Cochran again notes that rows in 
which - c or 0 may be added to the basic table without affecting the value of Q.* 



^Failure to take into account the fact that rows containing only I's or only O's 
do not generate new casesy i.e.y do not affect the sampling distribution of Qy has led 
to misleading statements about sample size. McNemar (l962y pp. 227**228) says that 
••The sampling dis-^ibution of [Q] follows the X® distribution . . . for N large (N>50y 
preatunably. )•' Siegel (I956y p. l62) saysy ". . . if the nxuaber of rows is not too 
small [Q] is distributed approximately as chi-square. . ." In his illustrative exampley 
one-third of the rows contain only I's or only O's. Hays (1965* P» 629) saysp "For 
relatively large K [number of rows] this [Q] is distributed approximately as chi- 
square. . In his illustrative exampley Hays includes a row of I's and a row of O's. 
Statements about sample size appropriate for the Q test are meaningless unless they 
exclude rows of I's and rows of O'Sy and illustrations of the Q test are misleading 
unless such rows are deleted. 
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The Q test is easy to apply. Ordinarily the most convenient computational formula 
is, 



(c-l)[cZTS - (ST^®] 

=i“i - ?“! 



( 2 ) 



To apply the formula to the data of Table 2, where the problem is to determine whether 
the three items v>iry significantly in difficulty, we have c - 3; - (12 )® + (5)® + 
(10)® - 269j - |u^ - 27; Ju® - (2)® + (2)® + . . . + (0)® + (3)® - 57. so that 



2(3(269) - (27)®] 
3(27) - 57 



Table 2. Responses of I9 subjects to three Miller Analogies 
Test items involving mathematical concepts. 



Subject 


1 


Item 
2 3 




u. 

1 


1 


1 


0 


1 




2 


2 


1 


0 


1 




2 


3 


0 


0 


1 




1 


4 


0 


0 


0 




0 


5 


1 


0 


1 




2 


6 


1 


1 


0 




2 


7 


0 


0 


0 




0 


8 


0 


0 


0 




0 


9 


1 


0 


0 




1 


10 


1 


1 


1 




3 


11 


1 


0 


0 




1 


12 


1 


1 


1 




3 


13 


1 


0 


0 




1 


14 


0 


0 


1 




1 


15 


0 


1 


1 




2 


16 


1 


0 


0 




1 


17 


1 


0 


1 




2 


18 


0 


0 


0 




0 


19 


1 


1 


1 




3 


Total, T. 


12 


5 


10 


XT. 


- |u^ - 27 



The corresponding P in a table of X.® at two degrees of freedom is .05>P^»025. The hy- 
pothesis that the items are of equal difficulty in the population can be rejected at the 
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5 per cent level,* 

When the rows having sums of 3 and 0 are deleted in Table 2 (Rows 4, 7, 8, 10, 12, 
18, and 19), - 13^-, =» - 18, and Zu? = 30. Substituting in (2), we have 

2[3(15^) - (18)®] 

Q - - 6.50, 

3(18) - 30 



as before. A moment's reflection will convince one that rows containing c I's or c O's 
do not affect the value of Q. Rows containing c O's obviously have no effect on Q in 
formula (2). Rows containing c I's do not affect the numerator of (2) since they in- 
crease the Tj by a constant. Nor do they affect the denominator of (2), since each such 
row will merely add c® to both terms. 



The conventional P teat in two-way classification, one score per cell, was applied 
to item scores, such as those of Table 2, i.s early as 19^1 by Hoyt. However, Hoyt was 
mainly concerned with the estimates of reliability and measurement error yielded by the 
P ratio and remainder variance. Cochran (1950) suggests the P test, as a method alterna- 
tive to the Q teat, for determining whether differences between columns (samples) are sig- 
nificant. He compares the results from the Q and P testa with the results obtained from 
the exact sampling distributions of Q in eight small samples. His comparisons will be 
elaborated in a later section. Cochran points out that the P teat, unlike the Q test, is 
affected by rows where u^ » c or 0.** 

When the conventional p test is applied to the data of Table 2, P_ tvirns out to 

2 y 

be 3.72* with P » ,036. However, when the rows whose sum is 3 or 0 are deleted, P^ 22 * 
4.09, and the corresponding probability is .030. * 

Blomqvist (1951) derives several tests for dichotomized data. His test statistic, 

^ ~ related to Cochran's Q statistic through the expression. 



ft(cZUi- Ju®) 
c(c - 1) 



(3) 



*If a definite probability figure is desired, it may be obtained from the normaliz- 
ing transformation of X®. Since X®/n - P„ ^ , Paulson's (19^2) normalizing equation for 
the variance ratio becomes ^ 

z - [ ^/x% + 2/(9n) - 1 ] / 2/(9n) 

where z is a normal deviate and n is the number of degrees of freedom for X® 

**Johnson and Jackson (1950) apparently overlook this point in their statement, 
p. 142, “The Q statistic Cochran proposed can, in fact, be expressed in terms of the 
pantities used in the usual analysis of variance test and would seem to possess no in- 
herent advantage over the latter." 
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as is apparsnt in formula (l)» above. One of the tests Blomqvist proposes is equivalent 
to the Q test. As the basis for another test, he shows that as the nxunber of columns £ 
increases, r and remaining fixed, the limiting distribution of S is normal. The normal 
approximation is diff*. '’ilt to apply, except where the row sums are equal. It is particu- 
larly tractable where the are each equal to c/2, when c. is even, or to (c-l)/2, where 
c is odd. We shall return to it in connection with the median test. 

The Two-Sample Case. If there are only two columns (samples) and if the rows which 
sxun to 2 or 0 are deleted, then each row sums to 1, and formula (l) reduces to Q - (T^^ - 
T2)®/r, with one degree of freedom. Hence z ■ (T^^ - where £ is a normal deviate, 

Tj^ and Tg are the column sums, and r is the number of rows having sums of 1. 

Now the sum + Tg) is equal to r, while the difference - Tg) is the difference 
between the number of rows having a 0-1 sequence and the number having a 1-0 sequence. If 
one of these numbers is designated h, the other may be written (r-h). Hence, z ■ (2h - 
r)/v'f", which corrected for continuity, becomes, 

z - i2h ^rl - _J, (4) 

Vt 

where h is either of the two column totals. 

The test embodied in formula (k) is commonly known as the sign test . It is equiva- 
lent to the teat for related-sample proportions proposed by McNemar (19^6); however, it 
does not require that the data be classified in a fourfold table. All that is necessary 
is to delete rows which sum to 2 or 0, count the number of remaining rows, find the sum 
of the I’s in either column, and substitute in (4). For a two-sided test, ordinarily 
appropriate, the probability corresponding to z is doubled. 

Accuracy of Large -Sample Testa . The minimum sample size (the minimum nximber of rows 
whose sum is other than _c or 0) for which the large-aample teats are appropriate ia not 
known. Since an increase in the number of samples (columns) also affects the distributions 
of Q and S, the number of samples as well as their size affects the accuracy of the approxi- 
mations. 

Both Cochran and Blomqvist consider the question of accuracy. Cochran constructed the 
exact sampling distributions of Q for the eight samples. 



No. of 


No. of 


Row 


No. of 


No. of 


Row 


Columns, jc 


Rows, r 


Totals 


Colximns, c 


Rows, r 


Totals 


3 


10 


5(2), 5(1)* 


k 


6 


5(3). 1(2) 


3 


10 


1(2), 9(1) 


k 


9 


3(3). 3(2), 3(1) 


3 


11 


1(2), 10(1) 


k 


10 


3(3). 3(2), 4(1) 


3 


16 


1(2). 15(1) 


5 


8 


2(4), 2(3), 2(2), 2(1), 



*The line ia read, "There are three columns (samples) and ten rows (sample sizes), five 
of the rows having sxims of 2 and five sxims of 1. " 
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by tae familiar method of randomization. He compared the P values obtained from uncor- 
rected and corrected X® and from corrected P with the exact P*e over the .003-. 200 range. 
He concludes) p. 263) 

None of the methods is free from bias. tends to overestimate 

and P* to under 0 at iii^ate. Over the range as a whole X® comes off 
fair! V well with 23 overestimates and 32 underestimates) but it ap- 
pearo that a negative bias in the region of 0.2 to 0.1 is being 
counteracted by a positive bios in the region of 0.02 to 0.003. For 
practical uses X® is preferable to P*) since it is slightly easier 
to calculate) though the possible application of F* to more complex 
tables should be borne in mind. ... At the true 39^ level, average 
errors of about 14^ are to be anticipated) which means that the tabu- 
lar approximations might give a value of 0.057 or 0.043 instead of 0.05. 

At the 1^ level the corresponding figures are about 0.012 and 0.008. 

These results appear close enough for routine decisions. For true 
probabilities below 0.005» all methods go to pieces. P' may give 
values only one-quarter of the true probability) while the two X® 
values may be six or eight times too high. 



Blomqvist gives the exact sampling distributions of S for the samples) 



Ho. of 


No. -'f 


Row 


No. of 


No. of 


Row 


Columns) £ 


ROWS) r 


Totals 


Columns) £ 


ROWS) r 


Totals 


4 


3 


3 ( 2 ) 


6 


3 


3(3) 


4 


4 


M2) 


8 


3 


3(^) 


4 


3 


3(2) 


8 


4 


4(4) 


4 


6 


6(2) 


10 


3 


3(3) 


4 


7 


7(2) 


10 


4 


M3) 


4 


8 


8(2) 


12 


3 


3(6) 


6 


3 


3(3) 


14 


3 


3(7) 


6 


4 


M3) 


16 


3 


3(8)) 



in which the row sums are each equal to c/2. In this special case) the distribution of the 
statistic) 4(c-l)s/cr) approaches the X® distribution with (c-1) degrees of freedom as r 
increases; while the distribution of S) itself) approaches the normal distribution with 
mean cr/4 and variance c^r(r-l)/6(c-l)) as £ increases. He makes seven comparisons of 
the P's obtained from uncorreoted X® and from the normal approximation) cor^^cted for 
continuity) with the exact P's nearest the 3^ point. The median percentage error for X® 
is 4? with range 4 to 129; that for the normal app<?@ximation) 40 with range 14 to 33* As 
would be expected) the normal approximation improves rapidly as the number of columns 
increases. 



THE EXACT DISTRIBUTION OP Q 



The c (>2) Saiagle Case . 



As Cochran (1930) showS) the exact sampling distribution 
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of Q Bay be generated by randonizationy the observed sub of the l*e in the 1,* s? J being 
regarded as fixed** Under the null hypothesis^ all different arrangenents of the '^s in 
the row have the sane probability. Hencey the possible results in the i,* row consist 
of the (u^) ways in which the u^ can be distributed among the o coluBns. The exact dis- 
tributions are constructed row by rowy the observations in all rows except the first being 
perBUted) as illuctrated in tho Appendix* Three distributions of Q are shown in Table 11 y 
p. l6* 

Table Ay PP»23-35» includes selected probability figures obtained from the exact 
sampling distributions of Q in samples ranging from two columns and twenty rows to six 
columns and five rows for the various combinations of row totals* The largest probability^ 
P» shown in any line of the table is the largest P less than *204 in the exact distribu- 
tion) the smallest P in an^ line is the smallest P not less than *005 in that distribution* 
The intermediate P»s are those nearest the 10?S, 59^» and 1?S points, respectively. Where 
fewer than five P's are shown in a line, they constitute all of the P's between *204 and 
*003 for that distribution* When an observed sum of squares of coluBn totals is less 
than the first recorded sum of squares for given o, r, and row totals in Table A, the 
corresponding probability is greater than *204j when the observed sum is greater than the 
last recorded sum, the corresponding probability is less than *005* 

The table is entered at the number of columns, number of rows, and row totals* For 
example, in Table 2, after deletion of rows having sums of 3 or 0, there are 12 rows, 6 
of which have sums of 2 and 6 sums of 1; hence. Table A is entered at 3{ 12} 6(2), 6(l). 

The sum of squares of column totals in Table 2 is 134* The exact probability of a sum 
of squares of column totals this large, if tae null hypothesis is true, is *051, as 
shown in the parentheses after 134 in the row 3? 12 j 6(2),6(l) of Table A* 

The sums of squares of column totals are tabulated in Table A, rather than the 
actual Q's, at the various levels of significance* Where a Q is desired, it Bay be 
readily obtained from formula (2) and the information given in the table* For example, 
the value of Q corresponding to the sum of squares of 36 in the distribution, c « 4, 
r - 5» with row totals 2(3)» l(2), 2(l), is 

3[4(36) - (I0)c] 

Q - — — - 8*25, 

4(10) - 24 

since |u| - 2(3)® + l(2)® + 2(l)c or 24. 

The use of Table A is further illustrated in testing for differences among the 
columns of Table 3» There are four columns and, after deleting the rows which suA to 



*Both Siegel (19^6) and Tatsuoka and Tiedeman (1963) state in effect that, under 

the null hypothesis, the I's are randomly distributed in the rows and col\imns of the 
table* It would be difficult to construct the sampling distributions of Q if random- 
ness prevailed in both rows and columns* 
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Table 5*# Reports of 9 patients of relief, 1, or of little or no 
relief, 0, imder treatment for asthma. 



Patient 


Drug 


Drug 


Placebo 


Placebo 


1 


1 


0 


0 


0 


2 


0 


1 


0 


1 


3 


1 


1 


1 


0 


4 


1 


1 


1 


1 


3 


1 


0 


0 


0 


6 


0 


0 


0 


0 


7 


1 


1 


1 


1 


8 


1 


0 


0 


0 


9 


1 


1 


0 


0 



*Prom Tate and Brown (1964). 



four or zero (Rows 4, 6, and 7), six rows. One of the rows sums to 3, two to 2, and 
three to 1, so that the row totals are 1(3), 2(2), and 3(l)» The column totals are 
5* 3* 1» and 1, whose squares sum to 36. Entering Table A at 4; 6; 1(3) » 2(2), 3(1) 
we find that the probability corresponding to 36 is .105* This is the probability of 
a sum of squares of column totals as large as 36 , if the null hypothesis is true. 

It should be noted that certain of the distributions under a given ^ and r in 
Table A can be paired. The distribution for 5» 3(4), 3(1), for example, differs 

from the distribution for 5; 4; 1(4), 3(l) only in location, i.e., values of sums of 
squares of column totals or values of Q. Many such pairs exist in Table A. Both mem- 
bers of the pair are included to simplify entry into the table. 

The Two-Sample Case . Although an exact test for the difference between two re- 
lated-sample percentages may be constructed by the method described above, it is not 
necessary. An exact test may be made by means of a binomial probability table, such 
as that compiled under the direction of Aiken (1933)* 

As noted in the preceding section, when all rows whose sum is 2 or 0 are deleted, 
the column totals sum to r, i.e., Tj^ + Tg = r. Whether Tj^ (or Tg) differs sufficiently 
from expectation, (r/2), to discredit the null hypothesis may be determined from the 
binomial (*5 + •3)^» example, if T^^ = 2 and Tg » 10 so that r = 12, we consult 

the cumulative binomial table at sample size 12, p = .5» and find that as few as 2 or 
as many as 10 successes have a probability of .0193 + ‘0195 ‘039* In terms of sums 

of squares of coliunn totals, a sum as large as (lO)® + (2)^ or 104 has a probability of 
. 039 » If the null hypothesis is true. 

Applying the approximation of formula (4) to the above data, we have. 
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The corresponding P is 2 (.0217) .043» 

In general, the probability obtained from formula (k) will be very close to the true 
probability in samples where r is about 20 or more. 



ACCURACY OF THE Q TEST 



Cochran's comparisons, mentioned earlier, indicate that uncorrected X® is a some- 
what better approximation than P to the exact sampling distribution of Q. Blomqvist's 
comparisons suggest that, at least when the number of columns is not more than six, the 
uncorrected X® approximation is better than the normal. Intuitively, one would expect %® 
to be the beat of the approximations. 

For these reasons and because the normal approximation is laborious, except where 
row sums are equal, we studied only the accuracy of the X® approximation, as applied to 
the distributions of Table A. For each of the sums of squares of Table A, we computed Q 
(X®) and obtained its definite P value by use of the normalizing transformation. We 
then determined the percentage error in each P from X® taken as an estimate of the exact 
p. Some of the results are summarized in Tables k, 5» and 6. 



Table k. Median and range of percentage errors in the X approximation 
over two regions of significance for selected distributions. 



Distribution* 


Median Percentage Error 


Range i 


Df 


Errors 


Columns 


Rows 


.204 - .005 


.100 - .020 


.100 




.020 


3 


6 


2% 


2\io 


6<fo 


- 


50fo 


3 


12 


18 


20 


6 




33 


4 


4 


29 


28 


2 


- 


39 


4 


8 


16 


13 


0 


— 


35 


5 


3 


38 


17 


0 


- 


44 


5 


5 


20 


12 


0 


- 


50 


6 


3 


32 


32 


10 


- 


68 


6 


5 


21 


11 


0 


* 


55 



♦All distributions having indicated numbers of columns and rows. 



It is apparent from tli© median percentage errors of Table k that the approximation 
becomes better as the number of rows increases for both regions of significance levels 
shown, particularly when c is greater than three. The ranges of errors, however, indi- 
cate that at no time, within sample sizes considered, is the approximation necessarily 

close. 

The medians and ranges of errors at the .204-. 101 and .019-. 005 regions (not 
shown in the table) are different from those at the .100-. 020 region. The former tend 
to be somewhat smaller than those at the .100-. 020 region; the latter, substantially 
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larger. The aedian of the 158 percentage errors over the .019-. OO 5 region was 5^ in the 
o-6y r-5 distributions. In particular^ the approximation tends to be very poor vhen £ is 
greater than three and exact P less than .010. Then, the approximation nearly always 
gives P's that are too large, frequently more than twice the size of the exact P's. In 
Table 10, p.l5 , P's from are compared with the exact P's in fourteen distributions. 

It will be seen that in a!.! but one case X^ overestimates exact P's near the .01 level. 



Table 5* Distributions of percentage errors in the X^ approximation 
over two regions of significance for selected distributions. 



Error Dis- 








Region and 


Distribution"' 






tribution 




.204 


- .005 






.100 - 


.020 




C-i 


3,r-12 


o>4,r-8 


o»5f 


5 c«6fr«5 




r«8 


c«5f ^“5 


c-6,r»5 


0-4 


9 


24 


16 


5 ^ 




16 


14 


51 


5-9 


4 


27 


28 


62 


2 


12 


24 


5^ 


10 - 14 


11 


48 


31 


62 


8 


18 


20 


44 


15 - 19 


13 


3^ 


32 


55 


4 


14 


8 


29 


20 - 24 


14 


22 


20 


5 ^ 


6 


4 


9 


24 


25 - 29 


5 


14 


25 


53 


3 


4 


5 


17 


50 - 3 ^ 


7 


4l 


22 


18 


5 


13 


6 


6 


35 - 39 




4 


6 


21 




1 


2 


6 


40 - 44 


2 




11 


11 






2 


2 


45 - 49 








10 








4 


50 - 5 ^ 




2 


10 


17 






2 




55 - 59 




2 


1 


9 








2 


60 - 64 




5 




6 










65 & Above 




2 


14 


71 










Median 


18 


16 


20 


21 


20 


13 


12 


11 



*A11 distributions having indicated numbers of columns and rows. 



The error distributions of Table 5* show that, as numbers of rows and columns in- 
crease, tho range of error gets considerably broader. What appears to be the explana- 
tion of this curious circumstance is the tendency of a few in the family of distribu- 
tions to take on atypical irregularities as £ and r increase but remain small. Inspec- 
tion of the original distributions of Q failed to find a consistent relationship be- 
tween munbers of columns, numbers of rows, and composition of rows which would enable 
one to anticipate poor approximations. At both the .204-. 101 and .100-. 020 regions, 
the approximation appeared to be somewhat more trustworthy in distributions having 
intermediate row sums [(c-l) >u^^ > l], but there were numerous exceptions. It may be 
that the Q test, as approximated by can never be wholly trusted. The Q distributions 
are occasionally unruly. (See Fig. 1, p.l?). However, with increasing sample size, the 
median error in the approximation to exact P decreases, and poor approximations should 
become relatively few in number. 

The under- and overestimates of Table 6 indicate that theX^ approximation nearly 
always underestimates exact P in the .204-. 101 region and, when £ ic greater than three, 
overestimates exact P most of the time in the .019-. OO 5 region. The approximation appears 
to be unbiased, vhen £ is greater than three, in the .100-. 020 region. These considers- 
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Table 6. Ntimber of times P from %® was greater than (+), equal to (0), or less 
than ( •■) exact P in selected distributions* 



Distributions^ 


.204 - .101 


Region of 
.100 - 


Exact P 
.020 


.019 - 


^ 


+ 


0 


4 * 


0 


- 


4 - 


0 




c*5» r«12 


14 






28 


10 


8 


5 


C“4, r«8 


1 63 


51 


9 


42 


72 


5 


2 


c-5, r-5 


60 


41 


8 


45 


55 


5 


6 


c«6, r«5 2 


104 


107 


19 


115 


155 


2 


5 



♦All distributions having the indicated numbers of columns and rows* 



tions may be helpful in interpreting the large-sample Q test, assuming that the same tend 
oncies exist in samples beyond the sizes considered. The assumption seems plausible and 
receives some support from the error comparisons of Tables 9 and 10. 

MEDIAN TEST IN TWO-WAY CLASSIFICATION OP QUANTITATIVE DATA 

Exact Median Test . Mood (1950) and Brown and Mood (1951) a test for column 

(or row) effects in the c by r table, one observation per cell. The test, known as a 
median test, is analogous to parametric analysis of variance in two-way classification. 

To test for column effects, i.e., differences between columns, the observations 
above the median of a row are replaced by I's; those at or below the median by O's. The 
resulting table is a c by r table of dichotomous data, with row sums each equal to c/2 
or (o-l)/2, depending on whether c is even or odd. Hence, the median test for column 
effects in the c by r table, one observation per cell, is a special case of the Q test. 

Consider the data of Table 7. The question of first interest is whether the 



Table 7. Average number of contributions to medicine by ages of contributors.* 



Field 


20-24 


25-29 


50-54 


Age 

55-59 


Interval 

40-44 


45-49 


50-54 


55-59 


60-64 


Bacteriology 


.010 


.050 


.040 


.050 


.025 


.055 


.011 


.022 


.023 


Pathology 


.006 


.024 


.051 


.055 


.055 


.026 


.019 


.054 


.021 


Anatomy 


.022 


.051 


.044 


.055 


VO 

0 

• 


.054 


.005 


.028 


.009 


Pharmacology 


.046 


.054 


.074 


.047 


.054 


.040 


.051 


.006 


.000 



*Abridged from Lehman (1955)* 



differences between columns (ages of contributors) are signif leant. When the values in 
each row are replaced by l‘s (above row median) and O's (at or below row median), the 9 
column and 4-row matrix results, as shown below, with row sums each equal to 4. The 



O 

ERIC 



12 



0 

0 

0 

1 



111 

oil 

oil 

111 



0 

1 

1 

0 



10 0 0 
0 0 1 0 
10 0 0 
0 0 0 0 



coluan totals are 1, 2, 4, 4, 2, 2, 0, 1, 0, whose squares sum to 46. Going to Table B, 
p.36, at 9 j 4; 4(4), we find that the sum of squares, 46, corresponds to a probability of 



.033. 



To test for differences between rows, the roles of columns and rows are reversed. 
When l*s and 0*s are assigned to the values in the respective columns, the resulting 
table is thought of as having 4 columns and 9 rows, with row sums equal to 2. When this 
is done, the column totals are 6, 6, 4, 2, whose squares sum to 92. According to Table B, 
this total corresponds to a probability greater than .204, since it is less than the 
smallest total entered under 4; 9; 9(2). 

Table B was constructed in the same way as Table A. (See p.21) Twenty-five of the 
distributions of Table B also appear in Table Ai they are repeated in Table B for ready 
reference. 



Although Brown and Mood discuss several advantages of the median test, they say 
little about its power. Since it reduces quantitative to qualitative data, it sacrifices 
information and would be expected to be less powerful than parametric analysis of vari- 
ance or the Friedman rank test. It is attractive mainly because of its freedom from 
assumptions and ease of application. 

Approximate Median Tests . As noted above, the median teat is a special case of the Q 
test; hence, formulas (1) and (2) may be used in the median test where sample size is be- 
yond Table B. Mood gives an approximation which is equivalent to that of formula (l) or 
(2). Applying formula (2) to the data of Table 7 where c<*9» r«4, Su^« 16, ZT^ ■ 46, and 
Zu| ■ 64, we get Q ■ 15»8 with 8 degrees of freedom. The corresponding P is .05 O25. 

Blomqvist's normal approximation, adapted to the Q statistic where the are equal to 
c/2, when c is even, or to (c-l)/2, when c is odd, turns out to have a mean of (c-1) and a 
standard deviation of •/ 2(c-l)(r-l)/r. In using the approximation, the difference 
Q-(c-l) should be corrected for continuity by subtracting the quantity 4(c-l)/rc, when c 
is even, or 4c/r(c+l), when o is odd. The corrections are embodied in the formulas below. 



z 



Q - (c-1) 



rc 



y 2(c-l)(r-l)/r 



y 2(c-l)(r-l)/r 



when c is even, or (5) 



when c is odd. (6) 



For the data of Table 7i where Q » 1^*89 c =* 9i and r « we havei 
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s 



15.8 - (9-1) 



M9) 

4(9+1) 



/ 2(9-1) (4-l)/4 



6.9 

3.46 



1.99. 



The corresponding normal probability is .023» the critical region being on the right side 
only. 

Accuracy of the Approximate Median Tests . Por each of the sruis of squares shown in 
Table Bf we computed Q and Zt obtaining definite P values for the Q's by means of the 
normalizing transformation ofX®» The median error of the 192 X® approximations to exact 
P»s was 22, with range from 0 to 600. Thirteen of the errors were overestimates by 100?^ 
or more; seven by 200^ or more. None of the underestimates was in error by more than 57?^. 
The median error of the normal approximation was 32, with range from 2 to 99» the upper 
half of the errors being well distributed over the 32 to 99 interval. 

To get a better idea of how the approximations might work in samples larger than 
those of Table B, we made the comparisons summarized in Tables 8, 9» and 10. The medians 
and ranges of Table 8 indicate that the X® approximation is better than the normal where 
there are twelve or fewer columns, but that the normal is better where there are thirteen 
or more columns— with numbers of rows as given. The over- and underestimates of Table 9 



Table 8. Median and range of percentage errors in theX® and normal approximations at two 
regions of significance levels for selected distributions of Table B. 



Distributions 


Median Percentage 

,20k - .005 .100 


Error 
- .020 


,20k 


Range of Errors 

- .005 .100 - 


.020 




X® 


Normal 


X® 


Normal 


X® 


Normal 


X® 


Normal 


c- 3»4, 5»6,7 
r«4 


2456 


37?^ 


179^ 


479^ 


396 - 15996 


89& - 769S 


396 - 5196 


996 - 7696 


c**8,9yl0,ll,12 

r-4 


26 


31 


14 


26 


1 - 165 


3-73 


1-57 


3-45 


c-13,14,15,16 

r-3 


47 


17 


40 


13 


i - 225 


2-44 


11 - 88 


5-24 



indicate that theX® approximation has a negative bias in the ,20k - .101 region and a 
positive bias in the .100 - .020* and .019 - *005 regions. The normal approximation shows 
a consistent negative bias in the .100 - .020 and .019 - .005 regions. 

The comparisons are sharpened in Table 10, where are shown the exact and approximate 
P»s at about the ^10, .05, and .01 levels of the exact P's for each of the largest samples 
at the given numbers of columns of Table B. 



*The positive bias in the .100 - .020 region disappears rapidly as the number of rows 

increases. Por five or more rows, the approximation gives about as many under as over 
estimates. 
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Table 9* lumber of times P from the and normal approximations was greater than (■(■), 
equal to (0)y or less than (-) exact P in selected distributions of Table B* 















Region 


of 


Exact P 










Distributions 


• 


204 - 


.101 








.100 - .020 






.019 


- .005 


X® 




Normal 




X® 


Normal 




X® 


Normal 




0 


- 


+ 


0 


- 


+ 


0 


- + 


0 - 


+ 


0 - 


+ 0 - 


o»3»^»5»6»7 

T>*k 




4 


2 




2 


6 




1 


7 


2 


1 


3 


0-8)9)10)11)12 

Tmk 




4 


2 




2 


9 




2 


11 


7 




7 


0-13,14)15,16 

r-3 




3 


2 




1 


7 






7 


4 




4 


Total 


0 0 


11 


6 


0 


5 


22 


0 


3 0 


0 25 


13 


0 1 


0 0 14 



The various comparisons suggest that, when there are fewer than about twelve columns 
and more than three rows, the Xf is better than the normal approximation at the .100-.020 
region of exact P in the median test. Whether or not the biases persist at the .204-. 101 
and .019-*009 regions^ the approximation should become better at all levels as the number 
of rows increases. The statement is supported both by the comparisons and the nature of 
As a matter of fact, the approximation should give better results regardless of 
the number of columnsy where there are five or more rows. 

When there are more than about twelve columns and fewer than four rowsy the normal 
approximation appears to be the better of the two. The seven exact P's over the .204- 
.009 region in the distributions having two rows and thirteen or more columns of Table B 
and the corresponding approximate P's are shown below. In six of the seven comparisons^ 



Exact P: 


.025 


ol43 


.015 


.100 


• 

0 

0 

VO 


.061 


.005 


P(X®) : 


.062 


.136 


.050 


.115 


.043 


.095 


.035 


Hz) : 


.031 


.152 


.020 


.108 


.012 


.073 


.008 


the normal approximation gives 


better 


results than 


the X®. 


Its 


median 


percentage error 



is 2k t while that of the X5 approximation is IkQm 

Where there are four rows and more than about twelve columns^ there are neither 
comparisons nor theoretical considerations to suggest which of the two approximations is 
preferable. However^ in this case the exact P should usually fall between P(X^) and 
P(z)y when P(7C?) is about .10 or less. 

As rules of thumb) in the median testy (l) given five or more rowSy use the 
approximation) (2) given more than twelve columns and fewer than four rowsy use the 
normal approximation) ( 3 ) given four rows and more than twelve colxmnsy take P(X^) as 
the upper limit of exact P and P(z) as the lower limit) when P( ) is about .10 or less. 
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Table 10. Exact P's nearest .10, .05» and .01 levels and corresponding 
P's from approximations to selected distributions of Table B. 



Distribution Probability P 

Columns Rows Exact X® Normal 



3 


12 


.115 


.104* 


.149 






.048 


.038* 


.013 






.012 


.009* 


.0002 


k 


10 


.091 


.084* 


.078 






.062 


.050* 


.026 






.011 


.013* 


.001 


5 


8 


.122 


.097 


.106* 






.048 


.050* 


.029 






.010 


.012* 


.002 


6 


6 


.075 


.075* 


.062 






.050 


.048* 


.027 






.008 


.013* 


.001 


7 


6 


.074 


.074* 


.061 






.048 


.048* 


.027 






.008 


.013 


.004* 


8 


5 


.087 


.082* 


.072 






.045 


.051* 


.030 






.010 


.019 


.003* 


9 


k 


.085 


.081* 


.071 






.033 


.046 


,023* 






.016 


.024* 


.006 


10 


k 


.117 


.108 


.111* 






.055 


.063* 


.044 






.008 


.019 


.004* 


11 


k 


.098 


.095* 


.087 






.046 


.055* 


.034 






.008 


.017 


.003* 


12 


k 


.135 


.123 


.129* 






.067 


.074* 


.057 






.013 


.024 


.007* 


13 


3 


.091 


.123 


.087* 




.051 


.048 


.024* 






.008 


.023 


.005* 


Ik 


3 


.121 


.117 


.117 






.043 


.061 


.038* 






.013 


.030 


.009* 


15 


3 


.066 


.078 


.059* 




.021 


.040 


.016* 






.006 


.019 


.003* 


16 


3 


.086 


.095 


.081* 






.031 


.051 


.025* 






.009 


.025 


.006* 



"Beat of the two approximations. 



Data for comparing theX® normal distributions with three exact distributions 
of Q are included in Table 11, and one comparison is made in Figure 1. 







*c^3t ^(2) indicates a basic table of 3 columns and ^ rows, with row suns each equal to 

0(2) and c=ll, r=4, ^(5) are read similarly. 



Relatire frequency Relatire frequency 












n 




.33 2.00 3.67 5.33 7.00 8.67 10.33 12.00 13.67 

Value of Q 

Fig. 1. Distribution of Q where c=5» r=8, 8(3), and fitted chi-square amd 
nornal curres. 
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CONCLUDING REMARKS 



In this study of the exact sampling distributions of the differences between srAll 
related-sample percentages and the accuracy of large-sample tests, some six hundred 
sampling diatribut'ons were constructed by randomization, and exact probability figtnres 
in tho .204-. 005 region were tabulated. The table of significance values extends to 
samploa yielding matrices varying in size from three columns and twelve rows to six 
columns and five rows, including all combinations of row totals. (The two-sample problem 
was treated as a special ease of the well-known sign test.) 

Goapar^uons of exact P's with approximate P's obtained from Cochran' 3 approxima- 
tion, the Q teat, indicated that the approximation shows consistent and marked improve- 
ment as the number of rows increases and some, though irregular, improvement as the num- 
ber of columns increases. The median errors in the approximate P's for the largest dis- 
tributions constructed fcr four or more columns were less than 15 per cent of the exact 
P in the .100-. 020 region. However, the ranges of errors indicated that at no time, with- 
in the scope of sample size considered, was the approximation necessarily closer than 53 
per cent of exact P. Since the ranges tended to get broader as the numbers of rows and 
columns increased, it may be that the Q teat is never wholly trustworthy. 

Where there are four or more columns;, the Q test nearly always underestimated ex- 
act P in the .200-. 101 region and almost as frequently overestimated exact P in the 
•®^9“»005 region. In the latter, the median error of the approximate P's was 56 per 
cent of the exact P's in the largest distributions considered. 

For samples beyond the sizes incl^^ded in the table, the Q teat, as a rule, should 
be satisfactory for practical purposes in the .100-. 020 region. As size and number of 
samples (rows and columns of the matrix) increase, both the median percentage error and 
the frequency of poor approximations decrease. However, in even relatively large samples, 
there is no certainty that a particular approximate P is a good estimate of the exact P. 

No consistent relationship between the number of coliimns, number of rows, and row totals 
was found which would enable one to anticipate poor approximations. Where the true sig- 
nificance level is needed, it would seem necessary to construct the exact sampling distri- 
bution. 

In the special cases where row totals of the matrix are each equal to half the number 
of columns, when that number is even, or to half the number of columns less one-half, when 
that number is odd, the Q test is equivalent to the Brown-Mood median teat for column (or 
row) effects in two-way classification, one observation per cell. For those cases, distri- 
butions were constructed for samples yielding matrices varying from three coliuins and 
twelve rows to sixteen columns and three rows, and the exact probability figures in the 
.204-. 005 region were tabulated. 

Comparaaona of the exact P's with the P's from theX® ahd normal approximations indi- 
cated that the Q test worked as well or better than the normal z test, except where there 
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were more than twelre columns and fewer than four rows. Then, the normal approximation 
appeared to be distinctly preferable. 
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APPENDIX: THE EXACT DISTRIBUTION OP Q 



The exact distribution of Q may be built up, row by row, by permuting the observa- 
tions in all rows except the first. Consider the case where there are four columns and 
three rows, with row totals 2 , 2, and 1. The procedure is. 



First Row: 

Permutations, 2nd Row: 
Column Totals: 



110 0 
110 0 
2 2 0 0 



110 0 
10 10 
2 110 



110 0 
10 0 1 
2 10 1 



110 0 
0 10 1 
12 0 1 



110 0 
0 110 
12 10 



110 0 
0 0 11 
1111 



At this point, the distribution of column totals, tmder the null hypothesis, is (2 2 00) 
with probability l/6, (2110) with probability 4/6f and (1111) with probability 1/6. 

in the third ro. (1 0 0 0, 0 1 0 0. 0 0 1 0. aM 0 0 0 i; are added 
to each of the column totals, and the results collected, the final distribution is. 



Column Totals 
3 2 0 0 
5 110 
2 2 10 
2 111 



Frequency 

2 

k 

10 

8 

W 



This is the distribution of possible column totals (from which Q or S is readily obtained) 
in a sample where c-4, r-3, with row totals 2(2) and l(l). The probability of such a 
sample having column totals of (3 2 0 0) is 2 /2k or . 003 , if the null hypothesis is true. 
The sum of squares of the column totals (3 2 0 0) is 13f and the entry in Table A is. 



if 3 2(2), 1(1) 13(.083). 



Although the above procedure could be used in constructing the distributions of Q 
for samples of any size, it would soon become extremely laborious. For example, given 
six columns and five rows, each row containing three I's, as in the median teat for 
column effects, there would be (20)^ or 160,000 sets of column totals. However, only 32 
of the sets would be different, and the 32 would yield only 15 different sums of squares 
of column totals or 15 different values of ft. 



Unfortunately, the procedure cannot be ©fficiently programmed for th© computer; 
however, it can be greatly simplified for manual computation. Suppose it is required to 
find the distribution of ft where c-6, r-if, with row totals 1(4), l(3)t 2(2). Since there 
are six columns, four rows, and eleven I'a, the possible column totals, arranged in 
descending order of sums of squares of column totals, are as shown under Distribution A 
below. The frequencies of the column totals of Distribution A may be obtained from the 
distribution for c-6, r-3, 1(4), 1(3), 1(2) or from any other distribution for c-6, r-3 
having three of the four row totals of Distribution A# 



The 6; 3; 1(4), 1(3), 1(2) distribution is shown Tinder Distribution B below. The 
purpose of the colons is to separate groups of like digits and thereby to facilitate 
the enumeration of permutations. Distribution B was obtained from a c-6, r-2 distribu- 
tion, the latter having been obtained by combining the permutations in the second row 
with the first row. That is, each distribution having c columns and r rows is built 
up from a similar distribution having c columns and r-1 rows. 



To obtain the frequencies for Distribution A from the frequencies and column totals 
of Distribution B, we must combine the permutations of a row containing two I's and four 
O's with the column totals of Distribution B. We proceed by subtracting each of the 
column totals of Distribution B from each of the column totals of Distribution A to see 
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Distribution A 
[6j4jl(4),l(3),2(2)] 



Distribution B 
[6;5;1(^), 1(3), 1(2)3 



Frequency 

3 
3 
3 
24 
11 
11 
20 

431111 

333110 
4 2 2 2 1 0 
4 2 2 1 1 1 
332210 
322220 
332111 
322211 
2 2 2 2 2 1 



Column Totals 



4 

4 

4 

4 

4 

4 

3 



0 

1 

1 

1 

2 

1 

2 



0 

0 

0 

0 

0 

0 

0 



Column Totals 

3 3 : 2 ; 1:0 0 
3 3:1 1 IsO 
3:2 2 2:0 0 
3:2 2:1 1:0 
3 : 2:1 111 
222 2 : 1:0 
2 2 2:1 1 1 



whether the larger can be obtained from the smaller by combining a row containing two 
1*8 and four 0‘s, and, if so, in how many ways. Pour of the 112 subtractions are shown 
below. The first and third subtractions indicate that the larger totals cannot be ob- 



443000 
3 3 : 2 : 1 :0 0 

1 1 : 1:-1 :0 0 



4 4 2 1 0 0 

3 3 :2: 1 :0 0 

1 1 : 0 : 0 :0 0 



4 2 2 1 1 1 
2 2 2 : 1 1 1 
2 0 0 : 0 0 0 



432110 
3 3 :1 1 1: 0 
1 0 :1 0 0 : 0 



tained from the smaller by adding a row containing I's and O's. The second subtraction 
indicates that the larger totals may be obtained from the smaller in only one way, but 
since the totals (3 32 100) have a frequency of 3, their contribution to the fre- 
quency of tfeo larger totals is 3* The fourth subtraction indicates that the larger 
totals may b© obtained from the smaller in 2(3) ways, since the first group of digits 
permits two permutations and the second three. Since the totals (331110) have a 
frequency of 3, their contribution to the frequency of the larger totals is 6 ( 3 ) or 10. 



The work is systematized in the following chart. If the column totals of Distribu- 
tion B are written on slips of paper, the calculation of their contribution to the fre- 
quencies of Distribution A proceeds rapidly. The subtractions are made mentally, and 
the numbers of permutations at the various row totals are entered in the chart. 



Distribution A 
Column Totals 



Frequency (Distribution B) 



3 3 



3 24 11 11 20 



Frequency 
(Distribution A) 



443000 

4 4 2 1 0 0 
433100 
4 4 1110 
432200 
432110 
333200 

431111 

333110 
4 2 2 2 1 0 
4 2 2 1 1 1 
332210 
322220 
332111 
322211 
2 2 2 2 2 1 



1 

2 

2 

4 

1 

2 



2 

1 



1 

6 

2 

3 

3 



3 

3 

2 

6 

1 



2 



1 

2 

1 

4 

1 

2 

2 



1 

4 

4 

6 



6 

4 

4 

1 



3 

9 

3 



0 

3 

6 

3 

15 

78 

12 

17 

30 

54 

68 

195 

68 

164 

341 

71 



15 15 15 15 



15 15 15 



1,125 



Totals 



C\J CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM CM KN 



TABLE A* 

SUMS OP SQUARES OP COLUMN TOTALS AND CORRESPONDING 
PROBABILITIES FOR THE RELATED-PERCENTAGE TEST 



No. of No. of Row Sums of Squares and (Probabilities) 

Columns Rows Totals 



4 4(1) 

5 5 1) 

6 6(1) 

7 7(1) 

0 8(l) 

9 9(1) 

10 10 ( 1 ) 

11 11 ( 1 ) 

12 12 ( 1 ) 

13 13(1) 

14 14(1) 

15 15(1) 

16 16(1) 

17 17(1) 

10 10(1) 

19 19(1) 

20 20(1) 



16(.125) 

25 (. 062 ) 

36(.05l) 

37(.125) 49(.016) 

50(.070) 64(.OO0) 

53(.1PJ) 65(.039) 

68(.109) 02(.O2l) 

05(.O65) 101(.012) 

90(.l46) 104(.039) 122(.006) 
109(.092) 125(.022) 

116(.180) 130(.057) 140(.O13) 
137(.118) 153(.035) 173(*007) 
160(.077) 170(.O2l) 

169(.143) 105(.O49) 205(.013) 
194(.096) 212(.031) 234(.OO0) 

205(.167) 221(.064) 241(.019) 
232(.115) 250(.04l) 272(.012) 



3 



3 3(2 

3 3(1 



4 


4(2) 


4 


3(2), 1(1) 


4 


2 ( 2 ), 2 ( 1 ) 


4 


1(2), 3(1) 


4 


4(1) 


5 


5(2 


5 


4 2 ), 11 


5 


3(2), 2(1) 


5 


2(2), 3(1) 


5 


1(2), 4(1) 


5 


5(1) 


6 


6 ( 2 ) 


6 


5(2), 1(1) 


6 


4(2), 2(1) 


6 


3(2), 3(1) 


6 


2 ( 2 ), 4 ( 1 ) 
1(2), 5(1) 


6 


6 


6(1) 


7 


7(2) 


7 


6(2), 1(1) 


7 


5(2), 2(1) 


7 


4(2 ,3(1 
3(2), 4(1) 


7 


7 


2(2), 5(1) 



10( 


.111) 


9( 


.111) 


32 ( 


. 037 ) 


25( 


. 074 ) 


20( 


. 074 ) 


17( 


.074) 


16( 


. 037 ) 


42 ( 


. 136 ) 


35( 


. 123 ) 


30( 


. 123 ) 


25( 


. 123 ) 


20( 


. 123 ) 


17( 


. 136 ) 


56 


. 177 ) 


49 ( 


. 177 ) 


42 ( 


.189) 


35( 


.101) 


30( 


.189) 


25( 


. 177 ) 


20( 


. 177 ) 


76( 


. 136 ) 


67 ( 


.106) 


62 ( 


. 093 ) 


51( 


. 123 ) 


44( 


. 123 ) 


41( 


. 093 ) 



50(.012) 

41(.025) 

32(.049) 

27(.049) 

26(.025) 

25(.012) 

62(.053) 

51(.095) 

44(.074) 

4l(.058) 

32(.074) 

27(.095) 

26(.053) 

70(.O78) 

69(.078) 

66(.019) 

53(.082) 

46(.O02) 

45(.019) 



34(.025) 

29(.025) 



53(.o49) 

46(.049) 

45(.OO0) 

34(.049) 

29(.049) 

06(.O21) 

73(*037) 

72(.005) 

57(.030) 

50(.030) 

51(.005) 



61(.OO0) 

50 (. 016 ) 

30(.O16) 

37(.OO0) 

75(.019) 

59 (. 022 ) 

52(.022) 



52(.OO0) 

4O(.OO0) 



6l(.01l) 

54(.011) 



* Use of the table is discussed on page 7 
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TABLE A (Con.) 



No. of 
Columns 



No. of Row 
Rows Totals 



Sums of Squares and (Probabilities) 



5 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

5 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 



7 

7 

8 
8 

8 

8 

8 

8 

8 

8 

8 

9 

9 

9 

9 

9 

9 

9 

9 

9 

9 

10 

10 

10 

10 

10 

10 

10 

10 

10 

10 

10 

11 

11 



1 ( 2 ), 6 ( 1 ) 

7(1) 

8 ( 2 ) 

7 ( 2 ), 1 ( 1 ) 



6 ( 2 ), 2 ( 1 ) 
5(2), 31) 
4(25,4(1) 
3(2), 5dS 
2 ( 2 ), 6 ( 1 ) 

1(2), 7(1) 
8(l) 

9(2) 

6(2), 3(1) 
5 2),4(lS 
^(2), 5(1) 
3(25,6(1) 
2(2), 7(1) 

1 ( 2 ), 8 ( 1 ) 

9(1) 

10 2 ) 

9 ( 2 ), 1 ( 1 ) 

8(2), 2(1) 




11 ( 2 ) 

10 ( 2 ), 1 ( 1 ) 



32(.106) 34(.078) 38(.037) 4o(.019) 

27(.136) 29(.078) 57(.02i) 

96(.142) 98(.110) 102(.059) 104(.033) 114(.008) 

89(.129) 93(.033) 99(.0l4) I0l(.007) 




) 821 


(.048) 


731 


[.055) 


) 721 


.014) 


) 57« 


•055) 


) 50( 


'•048) 



(.( 

77(.017) 8l(.008) 



78(.] 

69(.] 

66(.C 

53(.] 

167) 46(.ll4) 50(.048) 54(.026) 58(.007) 



6l(.017) 65(.008) 

(.< 



.129) 45( 
.142) 34( 

. 166 ) 126 ( 
.146) 113( 
. 189 ) 102 ( 

.167) 93(. 
.198) 82(, 
.198) 73(. 

.167) 66(, 
.189) 57(. 

.146) 50(. 

. 166 ) 45 (^ 

.178) 150( 
.178) 137( 
.202) 126( 

.180) 113( 
.I80) 102(, 
. 202 ) 93 (, 
.180) B 2 (. 

.180) 73(. 

. 202 ) 66 ( 

.178) 57( 

.178) 50( 

.132) 180( 
.094) 17l( 



.033) 5l(.0l4) 53(.007; 
.110) 38(.059) 40(.033 
.050) 132(.025) 134(.014 
.070) 117(.042) 121(.014 
.080) 104(.057) 110(.0l6; 



054 

076) 

076) 

054) 

O80) 



99(.025) 

84(.059) 

75(.059) 

72(.025) 

59(.057) 



.070) 54( 
.050) 51( 
.093) 154(. 

.106) l4l(. 

073) 132(. 

.099) 117(. 
.103) 106(, 

074) 99 (< 
103) 86(, 
099) 77(. 

073) 72( 

106) 6l( 

093) 54( 

098) 182(. 
054) 173( 



10l(.0l6' 
90(.Ol6 
8l(.0l6 
74(.Ol6* 
65(.016) 

.042) 58(.014] 

025) 53(.Ol4 
059) l66(.010j 

039) 149(.018) 
039) 134(.025) 

053) 125(.012) 
047) ll4(.015) 
039) 101(.026) 
047) 94(.015) 

053) 85(.012) 



039 

039 

059 

053 



74(.025) 

69 (. 018 ) 

66 (. 010 ) 

190 (. 026 ) 



3 


11 


9(2] 


l,2( 


;i: 


1 150(.123) 


152(.103) 


158( 


3 


11 


8(2 


l,3( 




• 137(.130) 


139(.101) 


l4l( 


3 


11 


7(2] 


l,4( 




1 126(.095) 


132(.055) 


134( 


3 


11 


6(2 


l.5( 




1 113(.127) 


115(.103) 


12l( 


3 


11 


5(2) 


l,6( 


1] 


1 102(.127) 


104(.103) 


iio( 



3 


11 


^(2), 7(1) 


93(.095) 


99(.055) 


3 


11 


3(2), 8(1) 


82(.130) 


84(.l0l) 


3 


11 


2(2), 9(1) 


73(.123) 


75(.103) 


3 


11 


1(2), 10(1) 


66(.094) 


72(.054) 


3 


11 


ll(l5 


57(.132) 


59(.098) 


3 


12 


12(2) 


210(.115) 


216(.070) 


3 


12 


11(2), 1(1) 


193(.l47) 


197(.09l) 


3 


12 


10(2), 2(1) 


178(.156) 


180(.123) 


5 


12 


9(2),3(i5 


165(.117) 


17l(.07l) 


3 


12 


8(25,4(1) 


150(.151) 


154(.087) 


3 


12 


7(2), 5(1) 


137(.153) 


14i(.082) 


3 


12 


6(2), 6(1) 


126(.117) 


132(.072) 



036) 179(.01l) 

.036) 166(.015) 
.061) 153(.012) 
.038) 140(.012) 
>038) 129(.0l4) 
.038) 118(.0l4) 

.038) 107(.012) 
,061) 98(.012) 
,036) 89(.015' 
.036) 80(.011 
.053) 69(.026; 

,048) 224(.017) 
.048) 209(.023) 
,052) 196(.009) 
,050) 179(.018) 
,051) 168(.012) 



129(.005) 

114(.010) 

94(.007) 

85(.007) 

69 (. 010 ) 

66(.005) 

168 (. 006 ) 

153 (. 006 ) 

14o(.007) 

129(.009; 

118(.007, 

107(.007, 

98(.007) 

89(.009) 

80(.007) 
73(.006" 
68(.006 
194(.010 
185(.007 

168 (. 008 ' 

155(.005 

146(.007 

131(.007) 

120(.007) 

113(.007) 

100(.005) 

9l(.008) 

86(.007) 

73(.010) 

230 (. 012 ) 
211(.013) 
204(.005; 
185(.011 
174(.005, 
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TABLE A (Con.) 



No. of No. of How 
Coliunns Hows Totals 



Sums of Squares and (Probabilities) 



3 12 5(2), 7(1) 113(a53) 

3 12 4(2), 8(1) 102C.151) 

3 12 3(2), 9(1) 93(.117) 

3 12 2(2), 10(1) 82(.156) 

3 12 1(2), 11(1) 73(.147) 

3 12 12 ( 1 ) 66(.115) 



117(.082) 121(.052) 131(.010) 137(.006) 
106(.087) 110(.05l) 120(.012) 126(.005) 
99(.071) 101(.050) 107(.018) 113(.011) 

84(.123) 90(.052) 100(.009) 108(o005) 

77(.09l) 81(.048) 89(.023) 9l(.013) 

72(.070) 74(.048) 80(.017) 86(.012) 



4 

4 

4 

4 

4 



2 

3 

3 

3 

3 




8(.167) 
27 (. 062 ) 
22(.125) 
17 (.188) 
19(.083) 



4 3 1(3), 2(1) 
4 3 3(2) 

4 3 2(2), 1(1) 
4 3 1(2), 2(1) 
4 3 3(1) 



11 (. 188 ) 

18 (. 028 ) 

13(.083) 

10(.125) 

9 (. 062 ) 



4 

4 

4 

4 

4 



4 

4 

4 

4 

4 



^(3 



, 1 ( 2 ) 

, 1 ( 1 ) 

:Kl.u« 



42(.203) 48(.016) 
37(.125) 41(.031) 
34(.047) 

34(.083) 36(.021) 
27(.156) 29(.062) 



4 

4 

4 

4 

4 



4 

4 

4 

4 

4 



2 ( 3 ), 2 ( 1 ) 

1 ( 3 ), 3 ( 2 ) 

1 ( 3), 2 2 ), 1 ( 1 ) 
1 ( 3 ), 12 ), 2 ( 1 ) 
1(3), 3(1) 



24(.047) 

29(.097) 33(.014) 
24(.083) 26(.042) 
19 (. 156 ) 21 (. 062 ) 
18(.047) 



4 


4 


4(2) 


24(.134) 


4 


4 


3(2), 1(1) 


21(.097) 


4 

4 


4 

4 


2(2), 2(1) 
1(2 ,3(1) 
4(1) 


18(.083) 

13(.125) 


4 


4 


lo(.203) 


4 


5 


5(3) 


63(.180) 


4 


5 


^(3), 1(2) 


58(.133) 


4 


5 


M3), 1(1) 


51(.105) 


4 


5 


3(3), 2(2) 


51(.146) 


4 


5 


3(3), 2(1) 


37(.199) 


4 


5 


3(3), 1(2), 1(1) 


44(.125) 


4 


5 


2(3), 3(2) 


44(.174) 


4 


5 


2(3), 2(2), 1(1) 
2(3), 1(2), 2(1) 


39(.l4l) 


4 


5 


34(.141) 


4 


5 


2(3), 3(1) 


27(.199) 


4 


5 


1(3), 4(2) 


39(.185) 


4 


5 


1 3), 2(2), 2(1) 


29(.l4l) 


4 


5 


1(3), 3(2), 1(1) 


34(.187) 


4 


5 


1(3), 1(2), 3(1) 


24(.125) 


4 


5 


1(3), Ml) 


21(.105) 


4 


5 


5(2) 


36(.109) 


4 

4 


5 

5 


4(2), 1(1) 
3(2), 2(1) 


29(.185) 

24(.174) 


4 


5 


2(2), 3(1) 


21(.146) 



26(.079) 

25(.014) 

20(.02l) 

17(.03l) 

16(.016) 








67 (.062) 
60(.039) 


66(.008) 






57(.012) 

55(.031) 


57(.016) 


59(.005) 




39(.105) 


41(.035) 


43 (.012) 




46(.070) 


48(.023) 


50(.016) 


52 (.007) 


46(.lll) 


48(.035) 


50(.028) 


41(.057) 


43(.031) 


45(.010) 




36(.047) 


38(.016) 


33(.012) 




29(.105) 


31(.035) 




41(.083) 


43(.056) 


45(.021) 




31(.057) 


33(.031) 


35(.010) 




36(.076) 


38(.028) 


42(.007) 




26(.070) 

27(.012) 


28(.023) 


30(.016) 




38(.047) 


42(.0l6) 


35(.021) 




31(.083) 


33(.056) 


32(.007) 


26(.lll) 


28(.035) 


30(.028) 


25(.03l) 


27(.016) 


29(.005) 





i 



J- 



I 



1 



I 



i 




O 

ERIC 
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TABLE A (Con.) 



No. of No. of Row 

Columns Rows Totals Stuns of Squares and (Probabilities) 



1(2), 4(1) 



10(.133) 20(.039) 26(.008) 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 



5 

6 
6 
6 
6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 





3(2), 3(1) 
2(2), 4(1) 
12), 5(1) 
6 ( 1 ' 

7(3, 





17 (. 062 ) 
92(.062 
05(.O53 
74(.106; 

i(.' 



98(.019' 
07(.O33! 
76(.o40; 
70 (.049 



65 (. 102 ' 
50(.19oj 
67( .122, 
601.105) 
5l(.19l) 

44(.173) 

60(.139) 

53(.109) 

46(.l46) 

39(.19l) 

34(.190) 

53(.142) 

46(.106) 

4l(.109) 

36(.105) 

29(.102) 
2k ol65) 
40(.117) 
4l(.l42) 
36(.139) 

31(.122) 

26(.146) 

21(.109 

10(.10O 

123(.077 

11O(.102) 

101( .132) 
ioi( .159) 

92(.135) 

03(.1O3) 

92(.170) 

03(.135) 

74(.102‘ 

67(.119 

03(*17O 




09(.O12) 

701.032) 

0O(.O13) 02(.OO9) 

75 (. 006 ) 

77(.009) 

59(.OO0) 



46(.103) 

62(.069) 

55(.O02' 

48(.O60 

4l(.O70] 

36(.073) 

55(.lll) 

401.090) 

43(.v/02 

30(.O40] 

31(.096) 
26 (. 106 ) 
50 (.102) 
43(.111) 





112 (.009] 

103(.073 

103(.103 

94(.069 

05(.O0l] 

94(.093) 
05(.1O9) 
76( .090' 
69(.079, 
07(.O00, 

70(.1O4) 

69(.107) 

62(.073) 

55(.079) 

70(.13O) 



40(.O5O) 

66(.032) 

57(.044) 

50(.055) 

43(.055) 

30(.O32) 

57C.062) 

52(.025) 

45(.044) 

42(.020) 

33(.05l) 
20(.O40) 
52 (.040) 
45(.062) 
42(.032) 

35(.036) 
30(.049 
27(.033 
26(.019 
127(.021 

114(.072 
105(.036 
105(.053 
90(.O35 
07(.O5i 

90(.O5O) 
07(.O60) 
70(.O0O 

711.043 

09(.O39 

0O(.O37) 

71(.o62) 

66(.034) 

57(.043) 

02(.o46) 



5O(.O30) 

60(.OO9) 

59(.015; 

52(.013, 

45(.029, 

42 (.009 

6l(.Ol6' 

54(.020; 

47(.015) 

44(.005) 

35(.02l) 

30(.032) 

54(.032) 

49(.Ol6) 

44(.009) 

39 (. 010 ) 

32(.013) 

29(.012) 

135(.005) 




1OO(.O10) 

91(.017) 

02(.O2O) 

75C.012 

93(*Ol4; 

04(.O14) 
75 (. 020 ) 
60( .014) 

6l(.012) 

06(.O11) 



4 


7 


2(3)»4(2),1(1) 


67(.10O) 


71(.O03) 


73(«037) 


77(.019) 


79( 


4 


7 


2(3), 3(2), 2(1) 


60(.17l) 


62(.095) 


66(.05l) 


60(.O2O) 


70 


4 


7 


2(3), 2(2), 3(1) 


53(.149) 


55(el07) 


57(.062) 


6l(.020) 


63( 


4 


7 


2(3). 1(2), 4(1) 


46{.102) 


40(.O90) 


50 (.000) 


54(.02o) 


56( 


4 


7 


2(3). 5 1) 


4i(.103) 


43 (.001) 


45(.052) 


47(.017) 


49 ( 



70 (. 006 ) 
6l(.009! 
54(.010 
47 (.000; 

63(.OO0) 

56 (.006) 
49(.009) 

39 (. 006 ) 

56(.011) 

5l(.OO0) 

46 (. 006 ) 

4l(.009) 

34(.009) 



122(.010) 
lllj .010) 
lll(.017) 
102 (.006) 
91(.010) 

102 (. 012 ) 
95 (. 006 ' 
04(.OO0 
77(.005 
95 (. 010 , 

06(.OO7) 

77(.01l) 

70(.007) 

63(.005) 

90 (. 006 ) 

.008) 
.013) 
, 011 ' 



4:- 4:- 4:- 4:- 4:- 4^- 4:- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- ^ 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- ^ 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4^- 4:^ 4 :- 4 ^ -T -T 4?- -P- 4^- -p- -T -p- -P^ 
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TABLE A (Con.) 



No. of 
C ' imns 



4 



No. of Row Suns of Squares and (Probabilities) 

Rows Totals 



7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

8 
8 
8 
8 
8 

8 

8 

8 

8 

8 

8 

8 

6 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

8 



1(3), 6(2) 69(.167) 
1(3), 5(2), 1(1) 6o(. 204) 
1(3), 4(2), 2(1) 53(.10O) 
1(3), 3(2), 3(1) 48(.122) 
1(3), 2(2), 4(1) 4l(.135) 

1(3), 1(2), 5(1) 36(.135) 

13 ,6a) 51 .132 
7(2) 62(.147) 
6(2), 1(1) 55(.167) 
5(2), 2(1) 48(.l49) 



4(2), 3(1) 
3(2), 4(1) 
2(2), 5(1) 
1 ( 2 ), 6 ( 1 ) 
7(1) 



41(.170) 

36(.170) 

31(.159) 

26 (. 182 ) 

25(.077) 



8(3) 156(.116) 
7(3), 1(2) 143(.193) 
7(3), 1(1) 132(.166) 
6(3), 2(2) 132(.200) 
6(3), 1(2), 1(1) 121(.163) 



71(.106) 73(.052) 
62(.120) 66(.069) 
57(.083) 59(.037) 
50(.104) 52(.037) 
43(.109) 45(.068) 

38(.069) 42(.035) 
33(*073) 35(.036) 
66(.090) 68(.04l) 
57(.106) 59(*052) 
50(.130) 54(.046) 

45(.088) 47(.039) 
38(.093) 42(.050) 
33(.103) 35(.053) 
28(.089) 30(.072) 
27(.052) 29(.021) 

158(.095) 16o(. 034) 
147(.072) 151(.033) 
134(.091) 138(.053) 
134(.117) 130(*O69) 
125(.09l) 127(.04l) 



79(.013) 8l(.007) 

701. 020) 74(.006) 
63(.019) 65(.008) 
56(.014) 50(.OO7) 
49(.017) 53(*006) 

44(.012) 46(.006) 
39(.014) 4l(.010) 
74(.01l) 76(.006) 
65(.013) 67(.007) 
58(.01l) 62(.006) 

5l(.Ol4) 53(.010) 
44(.018) 46(.012) 
39(.02l) 4l(.017) 
34 (.oi7) 30(.oio) 
57(.005) 

166(.017) 168(.007) 
153(.027) 157(*005) 
140(.019) 142 (.012) 
142(.019) 148(.006) 
133(.01l) 135(*007) 



6(3), 2(1) 

5 3), 3 2) 
5(3), 2(2), 
5(3), 1(2), 




4(3), 4(2) 
4(3), 3(2), 1(1 
4(3), 2(2), 2(1 
4(3), 1(2), 3(1 
4(3), 4(1) 



112(.126) 114(.105) 116(.035) 120(.016) 122(.011) 

121(.198) 125(.112) 127(.055) 135(.010) 137(.006) 

112(.152) 114(.130) 116(.051) 124(.009) 126(.006) 

101(.186) 105(.082) 107(.039) lll(.02l) 113(.007) 

92(.169) 94(.098) 90(.O52) 100(.023) 102(.013) 

112(.180) 116(.069) 118(.06l) 124(.0l4) 126(.010) 

103(.164) 105(.104) 107(.052) 113(.013) 115(*008j 

92(.202) 94(.121) 100(.032) 102(.020) 106(.007) 

83(.176) 87(.088) 89(.04l) 95(»009) 97(»006) 

76(.129) 70(.1O8) 80(.035) 86(.010) 88(.005) 



3(3), 5(2) 103(.194) 
3(3), 4(2), 1(1) 94(.146) 
3(3), 3(2), 2(1) 85(.166) 
3(3), 2(2), 3(1) 76(.154) 
3(3), 1(2), 4(1) 67(.176) 




60(.169) 
94(.173) 
05(.196) 
76 (. 181 ) 
69( .166) 



2(3), 2(2), 4(1) 
2(3), 1(2), 5(1) 
2(3), 6(1) 

1(3), 7(2) 

1 ( 3 ), 6 ( 2 ), 1 ( 1 ) 



60 (. 202 ) 

53(.106) 

48 (. 126 ) 

07(.156) 

70 (. 106 ) 



1(3), 5(2), 2(1) 
1(3), 4(2), 3(1) 
1(3), 3(2), 4(1) 
1(3), 2(2), 5(1) 
1(3), 1(2), 6(1) 



69(.196) 

62(.l46) 

55(.164) 

48(.152) 

41(.163) 



105( 


.128) 


90( 


.090) 


07 ( 


.110) 


70( 


.132) 


71( 


. 008 ) 


62 ( 


.090) 


90( 


.111) 


09 ( 


.070) 


80( 


.070) 


71( 


.110) 


62 ( 


.121) 


57( 


.082) 


50( 


.105) 


09 ( 


.088) 


80 ( 


.089) 


73( 


.070) 


66( 


.090) 


57( 


.104) 


50 


•130) 


45 


.091) 



lll(.04l) 

100(.043) 

09(.O55) 

80 (. 052 ) 

73(.041) 

66(.052) 

100 (. 056 ) 

91(.056) 

82 (. 062 ) 

73(.055) 

68(.032) 

59(.039) 

52(.035) 

93(.050) 

84(r044) 

75(.056) 

68(.043) 

59(.052) 

52(.05l) 

47(.04i) 



115(.013) 

106 (. 011 ) 

95(.015) 

88(.009) 

79(.009) 

68(.023) 

108(.01l) 

97(.014) 

88(.015) 

79(.015) 

70(.020) 

63 (. 021 ) 

56 (. 016 ) 

99 (. 012 ) 

88 (. 022 ) 

81(.014) 

74(.01l) 

65(.013) 

60 (.009) 

53(.011) 



117(.007) 

108 (.007) 

97(.009) 

90 (. 006 ) 

81 (. 006 ) 

70(.013) 

110 (. 006 ) 

99 (. 008 ) 

90(.011) 

81(.009) 

74(.007) 

65(.007) 

58 (. 011 ) 

103(.005) 

90(.017) 

83 (. 008 ) 

76(.007) 

67 (. 008 ) 

62 (. 006 ) 

55(.007) 



1(3), 7(1) 



56(.166) 38(.091) 42(.053) 44(.019) 46(.012) 



-^-*-*-* -d- -d- -d- -d- -d- irMrMTMrMTk irMTMrMrMTk irMfMrMrMTk irMfMrMrMTk irMrMfMrMTk irMrMrMfMTk irMrMrMfMTk irMfMrMrMTk 
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TABLE A (Con*) 



No. of No. of Row „ „ / 

Columns Rows Totals Squares and (Probabilities) 



4 



8 

8 

8 

8 

8 

8 

8 

8 

8 

8 

2 

2 

2 

2 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

4 
4 
4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 




2 2 ) 
2 ( 1 ) 
3(4) 





, 1 ( 1 ) 



1 ( 2 ), 1 ( 1 ) 

3 1) 

4(4) 

3(4), 1(1) 

2(4), 2(3) 

2(4), 1(3), 1(2) 
2(4), 1(3), 1(1) 
2(4), 2(2) 

2(4), 1(2), 1(1) 
2(4), 2(1), 
1(4), 3(3) 

1(4), 2(3), 1(2) 
1(4), 2(3), 1(1) 



4 1(4), 1(3), 2(2) 

4 1(4), 1(3), 2(1) 

4 1(4), 1(3), 1(2), 1(1) 

4 1(4), 3(2) 

4 1(4), 2(2), 1(1) 



36(.166) 38(.091) 

80(.l09) 82(.097) 

71(.156) 73(.088) 

62 (. 173 ) 66 (. 111 ) 

55(.194) 57(.128) 

48(.180) 52(.069) 

4i(.198) 45(.112) 

36(.200) 38(.117) 
31(.193) 35(.072) 

28(.116) 30(.095) 

16 (. 200 ) 

12 (. 100 ) 

8 (. 100 ) 

4(.200) 

36 (.040) 

29(.l60) 31(.080) 

26(.120) 

2l(.l60) 

26(.l60) 28(.040) 

23 (. 120 ) 

20 (. 060 ) 

12(.l60) 

23(.190) 27(.010) 

20(.090) 22(.030) 

17 (.060) 

17(.090) 19(.030) 

ll(.120) 

14(.120) 

14(.190) 18(.010) 

ll(.l60) 13(.040) 

8(.l60) 10(.080) 

9 (.040) 

58(.136) 64(.008) 

53(.064) 57(.Ol6) 

46(.l68) 50(.024) 

43(.032) 

50(.040) 52(.008) 

4i(.132) 43(.072) 

36 (.112) 38(.048) 
36(.144) 38(.084) 

31(.192) 33(.048) 

28 (. 032 ) 

41(.178) 43(.106) 

36(.198) 38(.114) 

33(.072) 35(.024) 

33(.102) 35(.042) 

23(.192) 25(.048) 

28(.120) 30(.048) 

28(.l66) 3o(.078) 

25(.072) 27(.024) 



42 ( 
84( 

77( 

68 ( 

63( 




019) 

024) 

012 ) 

oil) 

013) 



46(.012) 
94( .008) 
87(.005) 
78 (. 006 ) 
69(.007) 



54(.061) 60(.0l4) 62(.010) 
47(.055) 55(.010) 57(.006) 
42(.069) 46(.019) 52(.006) 
39(.033) 4 i(.027) 45(.005) 
32(.034) 38(.017) 4o(.007) 



45(.024) 

4o(.012) 

45(.04o) 

4o(.024) 42(.012) 

37 (. 012 ) 



34(.006) 









TABLE A (con.) 



2f 



No. of No. of Row 
Columns Rows Totals 



Stuns of Squares and (Probabilities) 



5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 




20(.112) 22(.048) 

19 (. 032 ) 

38(.151) 40(.043) 
33(.141) 35(.069) 
28(.lJ6) 30(.078) 

30(.lll) 34(.015) 
25(.102) 27(.042) 
20(.l44) 22(.084) 
25(.l4l) 27(.069) 
20(.198) 22(.ll4) 

17(.132) 19(.072) 
14(.163) 18(.024) 
22(.15l) 24(.043) 
17(.17 j) 19(.106) 
18(.040) 20(.008) 



42(.025) 

37(.02l) 

34(.006) 



' 9 (. 012 ) 

24(.012) 

29(.02l) 

24(.024) 26(.012) 

21(.024) 

26 (. 025 ) 

21(.040) 



5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

<5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 



4 

4 

5 
5 
5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 



4(4), 1(2) 

4(4), 1(1) 

5(4), 2(5) 

5(4), 1(5), 1(2) 
5(4), 1 ( 3 ), 1 ( 1 ) 
3(4), 2(2) 

3(4), 1(2), 1(1) 






13(.064) 

10 (. 136 ) 

88 (. 098 ) 

83(.069) 

72(.171) 

65(.l68) 

74(.146) 

67(.156) 

60(.109) 

60(.l44) 

53(.157) 

48(.083) 

67(.192) 

6o(.179) 

53(.203) 



2(4), 1(3), 2(2) 

2(4), 1(3), 1(2), 1(1) 
2(4), 1(3 ,2(1) 

2i4j;2[2),l(l) 

2(4), 1(2), 2(1) 

2(4), 3(1) 

1(^),M3) 

l(^j,3(3),l(2) 

1(4), 3(3), 1(1) 



55(.143) 

48(.139) 

4l(.186) 

48(.178) 

43(.153) 

36 (. 186 ) 

33(.083) 

62(.122) 

55(.177) 

48(.171) 



1(4), 2(3), 2(2) 
1(4), 2 
1(4), 2(3), 2(1) 
1(^),1(3),3(2) 



50(.135) 
3), 1(2), 1(1) 43(.198) 
38(.15B) 
45(.106) 
1(4), 1(3), 2(2), 1(1) 38(.198) 



1(4), 1(3), 1(2), 2(1) 33(.139) 



1,1(3), 3(1) 
1(4), 4(2 
1(4), 3(2), 1(1) 
1(4), 2(2), 2(1) 



)(.157, 

H.109; 



28( 

40( 
33(.17i; 
28(.203) 



1(4), 1(2), 3(1) 25(.109) 



17 (. 016 ) 

16 (. 008 ) 

92(.034) 

85 (. 016 ) 

74(.114) 

67(.083) 
76(.064) 
69(.04l) 
62 (.042) 
62(.062) 

55(.077) 

50 (. 026 ) 

69 ^,. 062 ) 

62 (. 092 ) 

55(.107) 

57(.042) 

50(.077) 

43(.128) 

50 (. 106 ) 

45(.058) 

38 (. 128 ) 

35 (. 026 ) 

64(.057) 

57(.059) 

? 0 (. 106 ) 

52(.063) 

45(.082) 

40(.058) 

47(.056) 

40(.082) 

35(.077) 

30(.077) 

42(.051) 

35 (. 106 ) 

30(.107) 

27(.042) 



76(.043) 

73(.006) 

80(.01l) 82(.006) 

71 (.024) 73(.OXO) 

64(.013) 66(.010) 

64(.029) 66(.012) 

57(.019) 59(.010) 

52 (. 006 ) 

71(.040) 73(*014) 75(*009) 

64(.04l) 66(.019) 68(.007) 

57(.030) 59(.019) 

59(.032) 61(.010) 

52(.029) 54(.010) 

45(.038) 47(.010) 

52(.042) 54(.018) 

47(.024) 

40(.038) 42(.010) 

37 (. 006 ) 

66(.029) 68(.Ol4) 70(.005) 

59(.049) 61(.017) 

52(.046) 54(.017) 

54(.027) 56(.008) 

47(.036) 49(.012) 

42( .024) 

49(.020) 51(.009) 

42(.036) 44(.012) 

37(.029) 39(.010) 

32(.019) 34(.010) 

44(.023) 46(.010) 

37(.046) 39(.017) 

32(.030) 34(.019) 

29(.013) 31(.010) 



i 
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TABLE A (Con.) 



No. of No. of Row 
Columns Rows Totals 



Svims of Squares and (Probabilities) 
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TABLE A (con.) 



No. of No. of Row 
Columns Rows Totals 



Sums Squares and (Probabilities) 



6 

6 



3 l|4j,l(2),l(l) 

3 2(3), 1(2) 

3 2(3), 1(1) 

3 1 ( 3 ), 2 ( 2 ) 

1 3 ,2 1 

3 1 ( 3 ), 1 ( 2 ), 1 ( 1 ) 

5 5 ( 2 ) 

3 2 ( 2 ), 1 ( 1 ) 

3 1(2), 2(1) 

3 3(1) 

4 4(5) 

4 3(5), 1(4) 

4 3(5), 1(3) 

4 3(5), 1(2) 

4 3(5), 1(1) 

4 2(5), 2(4) 

4 2(5), 2(3) 

4 2(5), 2(2) 

4 2(5), 2(1) 

4 2(5), 1(4), 1(3) 

4 2(5), 1(4), 1(2) 




4 1(5), 2(4), 1(3) 
4 1(5), 2(4), 1(2) 
4 1(5), 2(4), 1(1) 
4 1(5), 1(4), 2(3) 
4 1(5), 1(4), 2(2) 



15(.133) 

21(.16o) 23(.070) 

18(.190) 20(.040) 

15(.175) 17(.025) 

17(.04o) 19(.013) 

11(.O03) 

12(.200) 14(.067) 

14(.111) 

ll(.lll) 13(.022) 
0(.lll) 10(.056) 

9(.O20) 

72(.167) 74(.097) 

6TC.I67) 69(.037) 

62(.097) 66(.Ol4) 

55(.185) 59(.019) 

52(.023) 

62(.14i) 66(.022) 

52(.075) 54(.O30) 

4O(.105) 42(.074) 

32(.023) 

57(.067) 59(.039) 

50(.17O) 52(.059) 

45(.O03) 47(.037) 

45(.16i) 47(.O03) 

40(.153) 42(.042j 

35(.204) 37(.037) 

57(.093) 59(.058) 

52(.107) 54(.053) 

45(.204) 47(.113) 

40(.204) 42(.059) 

47 (.145) 49 (.040) 

37(.121) 39(.053) 



22 (. 010 ) 



73(.009) 



44(.007) 

6l(.01l) 

54(.022) 



49(.017) 



6l(.019) 

56(.009) 

49(.027) 51(.009) 

44(.015) 

51(.015) 

4l(.009) 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 



1(5), 1(4), 2(1) 

1(5), 1(4), 1(3), 1(2) 
1(5), 1(4), 1(3), 1(1) 
lpj,l|4|,l(2),l(l) 




27(.204) 29(.037) 

42(.120) 44(.040) 

37(.094) 39(.033) 

2(.140) 34(.044) 

2(.149) 44(.059) 

37(.155) 39(.077) 

32(.192) 34(.062) 

34(.O09) 36(.022) 

24(.153) 26(.042) 

29(.129) 31(.056) 



46(.013) 

46(.024) 

4l(.015) 43(.005) 

36 (. 012 ) 

30(.OO7) 

20(.O15) 

56(.017) 58(.010) 

51(.027) 53(.006) 

46(.023) 

46(.036) 




3(4), 1(3) 
3(4), 1(2) 
3(4), 1(1; 
2(4), 2(3] 



24(.204' 
21(.O03 
,1(1) 29(.094; 
20(.023 
!(• 



26( 
23(.037) 
31(.033) 



52(.138) 54(.074) 

47(.179) 49(.059; 
42(.152) 44(.06l 
37(.129) 39(.056. 
42(.102) 44(.O02) 
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TABLE A (Con.) 



No. of No. of Row 
Colunns Rows Totals 



Sums of Squares and (Probabilitios) 



6 k 2(4), 2(3) 



42(.182) 44(.082) 46(.036) 



6 

6 

6 

6 

6 

6 

6 

6 

6 

6 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 




37(.194) 39(.104) 41(.024) 
34(.O09) 36(.022) 38(.007) 
34(.119) 36(.033) 38(.015) 
29(.12l) 31(.053) 33(.009) 
24(.185) 26(.074) 28(.007) 

39(.13l) 4 i(.037) 43(.019) 
34(.148) 36(o052) 38(.024) 
29(.155) 31(.077) 33(*015) 
29(.194) 3^(*104) 53(.024) 
26(.120) 28(.040) 30(.013) 



^ 3 (. 011 ) 



45(.005) 

55(.005) 

35 (. 011 ) 



6 

6 

6 

6 

6 



4 

4 

4 

4 

4 




2l(.l6l) 23(.083) 
26(.152) 28(.06l) 
21(.204) 23(.113) 
lac.iyo) 20(.059) 
15(.185) 19(.019) 



25(.017) 

30(.023) 

25(.027) 27(.009) 

22 (. 022 ) 



6 

6 

6 

6 

6 



4 

4 

4 

4 

4 



M3) 

3(3), 1(2) 
3(3), 1(1) 
2 ( 3 ), 2 ( 2 ) 
2(3), 1(2) 



, 1 ( 1 ) 



X.179) 36(.071) 38(.035) 
3l(.13l) 35(.C37) 35(.019) 
26(.l49) 28(.059) 30(.023) 
26(.184) 28(.082) 30(.036) 
23(.145) 25(.040) 27(.015) 



40(.008) 

37(.005) 



6 

6 

6 

6 

6 



4 

4 

4 

4 

4 





20(.075) 22(.038) 

23(.179) 25(.059) 27(.027) 29(.006) 

20(.10?) 22(.053) 24(.009) 

17(.067) 19(.039) 21(.011) 

14(.097) ie(.0l4) 



6 

6 

6 

6 

6 



4 4(2) 

^ 5(2), 1(1) 
4 2(2), 2(l) 
^ 1 2), 3(1) 
4 4(1) 



20(.138) 22(.074) 
17(.093) 19(.058) 
I4(.l4l) 18;.. 022) 
11(.167) 13(.037) 
8(.167) 10(.0 ) 



24(.017) 26(.010) 

21(.019) 

17(.009) 



6 5 5(5) 

6 5 4(5), 1(4) 
6 5 ^(5), 1(3) 
6 5 4(5), 1(2) 
6 5 4(5), 1(1) 



113(.059) 117(.020) 

104(.176) 108(.040) 110(.008) 
97(.093) 99(.065) 101(.021) 
90(.094) 92(.040) 

81(.128) 83(.066) 



6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 



5 

5 

5 

5 

5 




5 

5 

5 

5 

5 

5 

5 

5 

5 




97 (. 122 ) 

90(.l4l) 

83(.l49) 

76(.091) 

83 (. 181 ) 

76(.157) 

69(.127) 

69(.158) 

62(.184) 

57 (. 066 ) 
90(.170) 
85(.079) 
76 (. 186 ) 
69 (. 162 ) 



99(.084) 

92 (. 078 ) 

85(.043) 

78 (. 026 ) 

85 (. 060 ) 

78(.057) 

71(.053) 

71(.075) 

64(.071) 

59(.019) 
92(.099) 
87(.039) 
78( .080) 
71(.077) 



101 (.032) 
94(.017) 
87(.017) 
80( .008) 
87(.025) 

80 (. 026 ) 

73 (. 012 ) 

73(.023) 

66(.015) 



94(.026) 

89 (. 016 ) 

80 (. 038 ) 

73(.018) 



96 (. 010 ) 

89 (. 006 ) 

82 (. 006 ) 

89(.01l) 

82 (.008) 
75(.007) 
75(.009) 
68 (. 006 ) 



96(.017) 
91 (. 008 ) 
82( .013) 
75 (. 012 ) 



98 (. 006 ) 

84 (. 006 ) 



1 
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No. of 
Columns 



No. of Row 
Rows Totals 



Sums of Squares and (Probabilities) 



6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 



5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 






. 2 ( 1 ) 










52 (. 110 ) 

71(.156) 

6M.177] 

57(.187, 

59(.135: 

52(.156; 
45(.201 
521. lee' 
47(.157) 
42 (.110) 

37(.066) 
85 (. 100 ) 
78 (.127' 
71(.157 
64(.l43l 



54(.031) 

73(.057) 

661.077; 

59(.107 

6l(.046 





56(.025; 

49 (.035 
56(.038 
51(.017, 
46(.006; 




73(.073; 
68( «056 
6l(.05i; 



.023) 

.024) 
.036) 
.029) 

75(.047; 
70 ( .021 
63(.022 
63(.033, 
56(.037, 



86(.005) 



29(.127 
39(.163 
34(.143 
29(.162 
26(.091 
21 (.128 



58 (. 006 ' 

51(.007, 

58(.01l' 



91 (. 012 ) 

84( .016' 

77(.013 

70(.010; 

77(.019) 79(.007) 

72(.007) 

65(.005 
65(.010 
58(.012 

72(.012) 

65(.016) 67(.007) 

60( .006} 

60 (. 011 ) 



49(.088; 
42(.156 
49(.111, 
42 ( .192 
37(.153l 

32 (.184) 
6i(.099) 
54(.167; 
49 (.108 
49 (. 133 ; 



5l(.04l) 
44( .071) 
51(.05T; 
44(.092 
39(.083, 

34(.071) 

63(.059) 

56(.087) 

51 (. 056 } 

51(.073) 



53(.013 
i(. 





50( .006 
43(.015 
50(.010 
45 (.005 

40(.006. 




33 (. 012 ) 

43|.032 



38(.029 

33(.018 

30(.008 




TABLE A (Con.) 
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TABLE A (Con.) 



No. of No. of Row Sums of Squares and (Probabilities) 

Columns Rows Totals 



6 

6 

6 

6 



5 

5 

5 

5 



4 ( 2 ), 1 ( 1 ) 
5 2 ), 2 ( 1 ) 
2(2 
1(2 




25(.100) 27(.054) 29(.025) 51(*012) 

20(.170) 22(.099j 24(.026) 26(.017) 28(.006) 

17(.122) 19(.084) 21(.052) 

14(.176) 18(.040) 20(.008) 



6 5 5(1) 



15(.059) 17C.020) 



* Use of the table is discussed on page 7 
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TABLE B* 

SUMS OP SQUARES OP COLUMN TOTALS AND CORRESPONDING PROBABILITIES 
POR THE MEDIAN TEST FOR COLUMN EPPECTS 



No. of No. of Row 
Coltunns Rows Totals 



Sums of Squares and (Probabilities) 



[ 






3 


3 


3(1 


3 


4 


4(1 


3 


5 


5(1 


3 


6 


6(1 


3 


7 


7(1 


3 


0 


0(1 


3 


9 


9(1 


3 


10 


10(1 


3 


11 


11(1 


3 


12 


12(1 



9(.lll) 
16(.037) 
17(.136) 
20(.177) 
27(.136) 
52(.l42) 
4l( .166) 

46( .170) 

57(.132) 

66(.115) 



25(.012) 

26(.053) 

29(.078) 

34(.110) 

^5(.050) 

50(.093) 

59(.098) 

72 (. 070 ) 



37 (. 021 ) 

30(.O59) 

51(.025) 

54 (. 059 ) 

61(.053) 

74(.O40) 



40(.033) 
53(.014) 
66 ( . 010 ) 
69 (. 026 ) 
0O(.O17) 



5O(.OO0) 

60(.OO6) 

73U010) 

06(.O12) 



4 

4 

4 

4 

4 

4 

4 

4 

4 



2 2 ( 2 ) 

3 3(2) 

4 4(2) 

5 5(2) 

6 6(2) 

7 7(2) 

0 0(2) 

9 9(2) 

10 10(2) 



0 (. 167 ) 
10( .020) 
24(.134) 
36(.109) 
40(.117) 
62(.147) 
0O(.1O9) 
90(.170) 
116(.107) 



26(.079) 
30(.O47) 
50( .102) 
66 (. 090 ) 
02(.O97) 
100(.104) 
122(.09l) 



42(.016) 
52 (.040) 
60(.O4l) 
04(.O56) 
106(.043) 
126 (. 062 ) 



54(.032) 

74(.011) 

90(.024) 

114(.010) 

136 (. 011 ) 



56 (. 011 ) 

76 (. 006 ) 

94(.OO0) 

116 (. 006 ) 

130(.OO9) 



5 

5 

5 

5 

5 

5 

5 



2 2 ( 2 ) 

3 3(2) 

4 4(2) 

5 5(2) 

6 6 ( 2 ) 

7 7(2) 

0 0(2) 



0(.1OO) 



14(.190) 


10(.O1O) 






22(,151) 


24( 


f.043) 


26(.025) 




?2(.O0O) 


341 


.060) 


36(.027) 


30 (.009 


s2(.130) 


44( 


.000) 


46(.053) 


50(.017 


54(.163) 


561 


.093) 


60(.037) 


64(.015 


60(.139) 


70( 


[.122) 


74(.O40) 


02(.O1O 



52(.007) 

66(.01l) 

04(.OO5) 



6 

6 

6 

6 

6 



2 2(3) 

3 3(3) 

4 4(3) 

5 5(3) 

6 6 ( 3 ) 



12 (. 050 ) 

21 (. 160 ) 

34(.179) 

51(.152) 

70(.13l) 



23 (. 070 ) 
36(.071) 
53 (.060) 
72(.075) 



30(.O35) 

55(.036) 

74(.050) 



4O(.OO0) 

57(.011) 

78(.013) 



59(.009) 

0O(.OO0) 



7 

7 

7 

7 

7 

0 

0 

8 
0 



2 

3 

4 


23) 

3(3) 

^(3) 


12(.029) 
2l(.079 
32 (.162 


1 23(.030) 

1 34(.065) 


36(.024) 


30(.O1O) 




5 


5(3) 


45(.203 


1 47(.131) 


49(.063) 


53(.016) 


55(.008) 


6 


6(3) 


62(.100) 66(.074) 


60(.O48) 


72(.014) 


74(.OO0) 


2 

3 

4 


2(4) 

3(4) 

4(4) 


16(.014) 

28(.140J 

46(.091 


1 30(.030) 

1 40(.O47) 


32(.010) 

50(.016) 


52(.006) 




5 


5 4) 


66(.l46j 


1 60(.O07) 


70(.o45) 


74(«010) 


76(o005) 



* Use of the table is discussed on page 7* 
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TABLE B (Con.) 



No. of 
Columns 


No. of 
Rows 


Row 

Totals 


Sums of Squares and 


(Probabilitie 


!S) 




9 


2 


2(k) 


I4(.l67) 


16(.008) 








9 


3 


3(k) 


26(.183) 


28( .069) 


30(.013) 






9 


k 




42(.165) 


44(.085) 


46(.033) 


48(.0l6) 




10 


2 


2(5) 


18(.103) 


37(.028) 








10 


3 


3(5) 


35(.085) 


60(.025) 


62(.008) 




10 


k 


M5) 


56(.117/ 


58(.055/ 




11 


2 


2(5) 


18(.067) 










11 


3 


3(5) 


33(.135) 


35(.042) 


37(.012) 




60(,008) 


11 


k 


^(5) 


52(.182) 


54(.098) 


56(.046) 


58(.020) 


12 


2 


2(6) 


22 (.040) 










12 


3 


3(6) 


4o(.165) 


42(.064) 


44(.017) 






12 


k 


M6) 


66(.135) 


68(.067) 


70 (. 032 ) 


72(.013) 


74(.005) 


13 


2 


2(6) 


22(.025) 










13 


3 


3(6) 


40(.091) 


42(.031) 


44(.008) 






Ik 


2 


2(7) 


24(.l43) 


26(.015) 


51(.013) 






Ik 


3 


3(7) 


47(.12l) 


49(.043) 






15 


2 


2(7) 


24(.100) 


26(.009) 


49(.021) 


51(.006) 




15 


3 


5(7) 


45(.l6l) 


47(.066) 




16 


2 


2(8) 


28(.06l) 


30(.005) 








16 


3 


3(8) 


52(.197) 


54(.086) 


56(.031) 


58(.009) 






